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Three ‘deen strategies for selecting number of instances. needed in con-~ 
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cept learning were investigated, Two strategies used ie dia P dcedures for 
the scteckich, while a nonadaptive strategy selected wneeunced AY number of 
ae Se ‘The data analysis showed that the full adaptive stra- 
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tepy fuse ‘ prétask and oli-task response data) fequired 25% less learning time 


a resulted ‘in better posttest! performance (p < .01) than the partial adaptive 
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Researchers investigating concept acquisition demonstrated a consistent 


({Houtz, wie Dave 19735: rlauoneter, 1976: Klausneier, Chagala, & Frayer, 
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“1974; vierrivt & Tennyson, 1977; Stolurow, al Tennyson, ‘steve, & Boutwell, 


‘followin 


1975). Dewign strategies derived from this research fireearuek include the 
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components: {a) presentation of the defining (rule) statement in 


terms Of critical attributes, (b) presentation or pivii ea tineances which | 
{ \ ; 
divergence of the variable BRET URES (critical ee nee 


£ Satine difficulty ratings. A dentine strategy for selecting, an ‘appropriate 


number /of iastructigaal ieee was Proposed by Markle. and Tiemann (1969). 
i + ¢ 
The: number of instances, referred to as a eaetwnat set, ads based upon “the | é 


sited of defined critical attributes al varlahle attributes of the apes 
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/ Klausmeier and Feldman (1975) investigated the number of instances needed 
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id conceptual learning, by, varying the number of rational sets presented in an 
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féxperimental learning task. Fhe design strategy used by Klausmeter and Feldman 
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follow Markle and Tiemann's (Note 2) proposal and practice in identifying 
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instances is necessary "ful concept mastery.’, Klausmefet and Feldman 
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_ hypothesized that selecting the mene of instructional instances be debeeulaind 


by the Humber of defined critical and variable aturthores as well as a set ae 5 ee 
Nou 
eka sets. The kesulte of their study aid not show a i cll on ene 
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ended between a treatment condition _composed of a minimal susie of sees : 


(one rational set of eight instances) and a practice condition with three’ 


‘ 


eee sets (24 total instances). However, it would appear from the Klaus- 


’ 


‘meler and Feldman (1975) study, that selecting the number of instances is not . 


necessarily ‘contingent -upon, the number‘of defined attributes or practine sets; 
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rather, i nimber of instancesl selarted for instruction aight be based upon | = 


learning differences (pretask capability and schhevencnt? and . 


ie + 


individual learning needs (on~-task learning requirements). 


’ * 


* . The purpose of f£his study was ‘to investigate a design strategy for 
selecting HUERER of PAB CENEES think would take into account "both ee indi-~ 
vidual” atcdeut aptitude and attitudinal differences and savas learning needs 


while maintaining an established standard of mastery, Implicit is that effec~ 
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\ that prevides a process for adjusting the basic learning environment (and in, 


. La m é ° o . 
this case, number of instances presented)’ to the unique learning characteris~ 
: 
{ 
Tennyson (1975) proposed an adaptive design strategy that would ‘select 


d ° 
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= and needs BE each student. 


instances in a concept learning task by analyzing a student's eacraletes a 


\ , : ¢ . : t- 


patterns. In a refinement of that strategy, Rothen and Tennyson (in press) 


LY 
designed a computer-based adaptiye management strategy that uses Bayes' theory 


of conditional probability to select an instructional sequence according to : 


4 
iddividual student characteristics and needs. The ane Eeehoe operation of 
r 1 


i las design strategy is related to guidelines described sol lene and 
f ij = a . : 
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Levis (1974) fat determining the minimal sas of posttests adequate to pres F 


é wie Beara ee ASRS SER the ies s degree of mastery of ae 
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behavior being tested. In this study modi fications to this standard Novick and 


. ‘ e Oy 


Ps Lewis (1974) methodology were made such that a, definite rule or algorithm 


ie 


selects number of instances from a table of generated Valet In addition, 
‘this procedure is applied Lerstively until either the etudent , is judged to _ 


have mastered the objective’ or the instructional instances pool is exhausted. 


‘This research tests the premise big the number of instances necessary in 
N 


a - Goncept learning sae can be Setatatinad by “individual differences and need; 


we hyporhesteed ast an adaptive design strategy (in this case asin Bayes’ 


‘ ‘ 


theory) that uges ; preméasure (aptitude), pretest (prior neiveveusntd and 


ontask performance (learning) data would result in more effective concept 


- AY 


earning than an adaptive model that uses only pretask (premeasure and pretest) 
‘data. (difeceive learning is defined as student ability to perform skillfully 
‘and economically.) We or hypothesized that both the full (pretask and 
ontask measures) adaptive design strategy and thie, partial (pretask only) adap-~ 
pive design strategy would result in better sttnevivetncs than a bc a sia 
strategy (the number of instances, sieve ti according to number of eeirieat and 


variable attributes and practice subst) si ‘ ‘ 


7 ee Method — 


Students and Design 
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‘ Participants (N-67) were undergraduate male and female students from the 
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general aiid mun gSet pool at epee yesaaky of Minnesota. Students were 


given course credit for participation in this sae A one-way experimental _ 


design ae of three treatment sondivbans was used with multivariate 
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ahilysis of covariance. The, three experimental conditions were (a) an adap-+ 
. v . i 


tive modél which used pretask‘and ontask data‘to select numbergof instances, 
oe . ; ’ 
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oan. + (b) a partial adaptive model which used only pretask data for selecting number 


. 


| of ‘instances, and (c) a nonadaptive model which consisted of a set number of 


| é instances determined by number of critical and variable attributes (Klausmeier, 
‘ 4 “ _ 

: 1976). Dependent variables were correct scores on the posttest, ontask learning 
; ' 4 . 
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. . time, and an effectiveness score (a ratio calculated by dividing the posttest 
. , “we ; ry * 
score by the ‘entask time).— ; bs 
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” Learning Program , * we 4 , 
Two legal concepts assoctated with court decision-making were used in the 


learning program:' best evidence rule and hearsay. The learning program 


required that the student assume the role of the judge in a civil case in a 
Federal District Court and ryldé on objections to questions asked to witnesses, 


by either the plaintiff's or defendant's lawyer. The instances were writtert 


{ so that the student had to respond to the objection by identifying it as best 
‘ a 
evidence rule, or hearsay, or’ overrule. . ; " 
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eadtwent programs. /Three computer-assisted instruction treatment nee 
; grams ied developed as follows:. — “a ; 
we Program eee: the full Bayesian adaptive model to select number of 
Litnences: w be presented to each student individually. That is, the, pretask i 
- data (premeasure ecaiee on syllogisms and. pretest 'score) bavablished a@ pre-~ 


4 . 


scribed number of instances for the Jearning task whilé student ontask 
~~, ° : a - 
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responses modified that prescription. ‘ . eS F 
' : t 
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- ‘ Program two consisted of a partial Bayesian adaptive model which used * 
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4 x * & + : 
only the pretask information to determine number of instances. The premeasure , 


and pretest scores provided the data to prescribe individual learning task 
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Program three was nonadapt ive model in which students received the same 
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“number of instances, ‘The: number of instances per concept was determined by 


eon number Of critical attributes (two), number of variable attributes (three; 
& + et i ‘ ; ™ ! 

. evidence, testimony, and assertion) and practice (two instances per attribute; 

. z cd 


ma Klausmeler, 1976). Therefore, thé nonadaptive learning task consisted of 10 
‘ x * ‘ : 2 
hearsay, 10 best evidence rule, and 10 overrule instances’ (30 total instances). 
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Bayestan Probability Model . i . 
- Following is:a ce abe functional logic of the computer-based 


Bayesian adaptive Verate used‘in this research study. The strategy is a 


management’ system which détermines number of instances to be presented to each 


student. The computer program includes a premeasure (both a performance and 


. 


: - time measyre) From which each student’s loss ration was calculated, A pretest 
wag then administered from which the, prior Beta distribution was selected, 
f 


From this distribution table, the number of instances was determined, while 


the ontask responses were used to adjust this number. . 


“ Procedures. Since the instructional materials for the thread treatments, 


4 
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except for the tieeed Tuebtainy were presented via computer terminal, the students ? 


. : -were treated on an individual basis. : 


Results’ - ‘ ; 
* . ' 


A multivariate analysis of covariance test was used, with ontask time 


fl 
’ ny 


; | 
and posttest correct score as dependent variables. Ontask time refers to the ) 
medsured time period in which students were interacting with the learning 


program; this time did not include pretask time or posttest time. The posttest 


» . e 


consisted of 20 items, eight best evidence instances, ‘eight hearsay instances, 
and four forms of;overrule objections. The myltivariate test was significant, 
\ 


U (2, 1, 64) = 51, p < .001. The first contrast test tested the hypothesis 
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that the adaptive strategy was more effective than the partial adaptive stra- = 
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tegy. The results showed a difference between the two conditions. u-ti,4, 64) 


es al aad | Contrasting the two adaptive conditions with the nonadaptive ° 
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U (1, 1, 64) = :63, p < .001. 
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eondition resulted in the hypothesize difference, 
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Ontask time mean differences between the three treatment conditions ranged 
ry = } * < y 


from 14.0 minutes for the full adaptive group (pretask and ontask measures for, . 
ascii number of instances) ‘to 23. 4-minutes for tha nonadaptive group (number 


of thabaicen cag ay a rational set of critical and variable attributes and | 


t 


Hey “peated s wien 18.8 minutes for. the partial adaptive group (pretask only data 


a 


used for ree instances). tleteg’ a cnesay analysis of variance, the F test 
was significant, F’(2, 64) = 15.6, p < .0001. Two multiple range tests, Student~ 
: : 05 ae 
Newman-Keuls and least significant difference, showed that each treatment mats 
was different at an alpha level of .Ol. That is, the full adaptive group's 
time bial finieidas the tdarntag program, a full four miputes faster than the ; 


fare adaptive oe: and nine minutes faster than the nonadaptive group, was - 


significantly better than the EWO. ates groups; the five minutes differenee 


between the partial adaptive-group and the nonadaptive group was likewise 


‘significant. The analysis of variance test on pretask time, including the 
t ‘ 
syllogism test, direcgions, and pretest, was nonsignificant (average’pretask 


t / 
' 


" time for all groups was 17.2 minutes) , F (2, 64) = .64, p.< .99. Also, the 
4 J F-test on posttest time ‘showed no, Bae Pperenee between the three ani ‘(average 
i posttest time ts WW: 2 penned F (2, 64) = 2.10, p< 23. 
Posttest correct scores (20 item test) were analyzed watde the gienéansiee 
/ (syllogism test) as a covariate; resulting in a difference between the three ° ! 
: Bkoup ineane, F (2, “63) = 15.82, p © .001, Students in the full adaptive group: 


(M = 16. 9} had a'correct mean score of over four polnts higher than, the non- 


’ © 


. ; sdadihus group (4! = 127) Students in the partial plete group (M = 14, 4) 
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had a correct meanrscore that was two points higher than the ynonadaptive group 
r] . 


-M = 42.7). The Student-Newman-Keuls' test showed that each of the three group 


s 
wr 


means were different at .05, with the least signiflcant difference test showing 


é « 4 . 


a .01 difference. The pretest cdtrect mean score F test between the three . 
1 
groups was nonstgnificant (p > .05). : : | 


* lp m8 
The third dependent varfable represents an effectiveness measure of the 
‘ & 
* 4 


learning programs. Effectiveness is defined here as student abiljty to perfo 
4 Pr 


. - { 
wel] and economically. The effectiveness ratio was calculated for each student 


~ - . 
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by dividing the posttest correct score by the ontask time. An analysis of 


. a ot - . 
es test resulted in a significant difference between the three groups, 


_F.(2, 64) = 23.76, p < .0Q1. Student-Newman-Keuls’ test showed that the most 


“ 


effective learning program used the full adaptive strategy for selecting number 
. - a ‘ « 
of instances (p > .05; the least significant difference was p >'.01). Also, 
a . ‘ “ 
studente in the partial adaptive group had an effectiveness mean score signifi-~ 


cantly different (Student-Newman-Keuls, p > .05; least significant difference, 


® 


p > .01) from the nonadaptive group Students, 
i ws 
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> ‘ Discussion - 
The impact of Bayes' theory in the context of a design strategy for 


selecting numbers of. instances, based upon a*probability of mastery was shown 
4 


in vie ontask learning time differences between the adaptive and nonadaptive © 
strategles. Bayes’: theory in the context SE an énstvuctional design strategy i 
provides ‘each baat with an titlividually selactba number of instances. 
Furthermore, the ontask student resporise measurement component of the full 


adaptive strategy allows for continous updating of the predition of learning 


success, resulting in possible modifications in the selected number 'of 
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instances. We did expect ontask time differences between the three treatments, 


4 * 


i * es fe é + 
> {but the amount differnce (25% between the full adaptive strategy and the par- 


tial adaptive strategy, and 16% between the partial adaptive strategy and 
’ ‘ . 


: design éontrol strategy) exceeded anticipations( * The ontask iteration % 
, teh oe ° 


capability of the full adaptive -strategy, in, updating each student's’ proba- 


. 


. . 


bility of mastery, extends the aptitude- (or achievement) treatment inter- 


action research. > sey 


. Posttest performance outcomes suggest a phenomenon associated with student’ ‘ 


| interest in, content, once learning of the content is assumed by the student, 
. * én + 


‘ may be operating. Students in the full adaptdve group not only finished the 

| learning task au dade time than the students in the nonadaptive treatment, but | 

| they souumend 85%, of questions on the posttest correctly compared to only 64% 
for ‘the students in thg nonadaptive group. Aeudebee ta the full adaptive treat- 

_y ment were immediately given the posttest- when mastery of the task was predicted; 
“whereas, the nonadaptive students had to remain ontask until all instructural 


: instances were presented. We interpret these differences on the basis of 


« 


elicited student interest. That is, in a learning environment where no attempt : - 
* t 


« 


is made to adjust instructional time when learning has occured, students may 


lose interest (motivation) in the task which may also result in a deterioration 


- e 
» 
Py 4 


of performance. « ° ‘ by . 
The effectiveness ratio was calculated in reference to ‘the assumption that 
performance ai learning time are madus woes ies in assessing an instruct fonal 
treatment. Resdarch on instructional variates shoutd demonstrate not only 
better learning outcomes but also more efficient learning. The effectiveness: 
» ~ ¥atio between the full adaptive strategy ee Aes strategy (.6) 


. ~ 


of almost 2 to 1 further demonstrates the impact of using ontask learning -4 
« ” 
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i" measures to select number of instructional instances, especially when comparing 


“the ratios of-the partial adaptive strategy (.9) and the nonadaptive strategy 
(63% Thi effectiveness ratio clearly shows that ontask measures for 


« 


modifying an instructional length, wiile maintaining a specific level of mastery, 


: } ‘ 
.can achieve significant gains in student learning over that of-only pretagk 
ry \ ra \ : ‘ 


measures. 
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